Wearable terminal device, photographing system, and photographing method

ABSTRACT

A wearable terminal device includes circuitry configured to receive sensor data from one or more sensors, wherein the sensor data corresponds to a behavior of a user in possession of the wearable terminal device. The circuitry is configured to determine, based on the sensor data, the behavior of the user. The circuitry is configured to control, based on the determined behavior of the user, a photographing interval of a camera.

BACKGROUND

1. Technical Field

The present disclosure relates to photography using a wearable terminaldevice and related control processing based on sensor inputs.

2. Description of Related Art

The “background” description provided herein is for the purpose ofgenerally presenting the context of the disclosure. Work of thepresently named inventor, to the extent it is described in thisbackground section, as well as aspects of the description which may nototherwise qualify as prior art at the time of filing, are neitherexpressly nor impliedly admitted as prior art against the presentdisclosure.

Wearable devices may include a camera for capturing image data. Thecamera may be controlled such that photography is captured automaticallyat a fixed photographing interval. For example, a camera may be includedin a wearable device for capturing image data in a surrounding arearelative to a user for the purpose of creating a “life log”corresponding to the user.

SUMMARY

Wearable devices that include a camera that automatically captures imagedata at a fixed interval lack the capability to adapt the photographinginterval and therefore, there exists a problem that although thesurrounding area and/or object being photographed changes very littlerelative to the user (e.g., the user is resting and the surroundingenvironment does not change during the photographing), redundant imagedata is still being captured. In other words, there may be times whenphotography at the predefined fixed interval is inappropriate becausesuch photography would result in substantially duplicate photographs,which needlessly consumes storage space and processing capacity. Inlight of this problem, a device, method and system of capturing imagedata with a wearable device that includes circuitry to control aphotographing interval based on a detected state of the user and/orother contextual factors is needed.

In one or more embodiments, a wearable terminal device includescircuitry configured to receive sensor data from one or more sensors,wherein the sensor data corresponds to a behavior of a user inpossession of the wearable terminal device. The circuitry is configuredto determine, based on the sensor data, the behavior of the user. Thecircuitry is configured to control, based on the determined behavior ofthe user, a photographing interval of a camera.

The foregoing general description of the illustrative embodiments andthe following detailed description thereof are merely exemplary aspectsof the teachings of this disclosure, and are not restrictive.

BRIEF DESCRIPTION OF THE DRAWINGS

A more complete appreciation of this disclosure and many of theattendant advantages thereof will be readily obtained as the samebecomes better understood by reference to the following detaileddescription when considered in connection with the accompanyingdrawings, wherein:

FIGS. 1A and 1B illustrate a non-limiting exemplary external views of awearable terminal device, according to certain embodiments;

FIG. 2 illustrates a non-limiting exemplary block diagram including theinternal structure of a wearable terminal device and a communicationapparatus that form a photographing system, according to certainembodiments;

FIG. 3 illustrates a non-limiting exemplary photographing interval tablefor controlling a photographing interval of a wearable terminal devicebased on a detected behavior, according to certain embodiments;

FIG. 4 illustrates a non-limiting exemplary sequence diagram forcontrolling a photographing interval of a wearable terminal device,according to certain embodiments;

FIG. 5 illustrates another non-limiting exemplary block diagramincluding the internal structure of a wearable terminal device and acommunication apparatus that form a photographing system, according tocertain embodiments;

FIG. 6 illustrates another non-limiting exemplary block diagramincluding the internal structure of a wearable terminal device and acommunication apparatus that form a photographing system, according tocertain embodiments;

FIG. 7 illustrates a non-limiting exemplary photographing interval tablefor controlling a photographing interval of a wearable terminal devicebased on a detected physiological state, according to certainembodiments;

FIG. 8 illustrates a non-limiting exemplary photographing interval tablefor controlling a photographing interval of a wearable terminal devicebased on a detected emotional state, according to certain embodiments;

FIG. 9 illustrates another non-limiting exemplary block diagramincluding the internal structure of a wearable terminal device and acommunication apparatus that form a photographing system, according tocertain embodiments; and

FIG. 10 illustrates a non-limiting exemplary photographing system thatincludes a server with circuitry for controlling a photographinginterval of a wearable terminal device, according to certainembodiments.

DETAILED DESCRIPTION

Referring now to the drawings, wherein like reference numerals designateidentical or corresponding parts throughout the several views.

FIGS. 1A and 1B illustrate non-limiting exemplary external views of awearable terminal device, according to certain embodiments. The wearableterminal device 20 shown at FIGS. 1A and 1B includes a main body 3, aprojection 4, a ring 5, a slide part 7, a camera 24, and an operationkey 29. FIG. 1A illustrates the wearable terminal device 20 in a statein which the slide part 7 is in a closed position in order to protectthe lens of camera 24, and FIG. 1B illustrates the slide part 7 in theopen position. In the exemplary embodiments shown in FIGS. 1A and 1B,the slide part 7 may be slid along tracks, grooves, etc., formed in themain body 3 such that it may move up and down in order for the slidepart 7 to be placed in the opened and closed position.

The operation key 29 may be a switch or a button for controlling powerto the wearable terminal device 20. In certain embodiments, an automaticimaging process according to the present disclosure may be initiatedsimultaneously when powering on the wearable terminal device 20 via theoperation key 29. Other functions may also be assigned to the operationkey 29, such as the manual capturing of images by the camera 24.Further, a wearable terminal device according to the present disclosureis not limited to having a single operation key, but rather moreoperation keys with other functions may also be included in the device.In certain embodiments, the automatic imaging process according to thepresent disclosure may also be stopped by pressing the operation key 29.

A hole is formed in the projection 4 such that the ring 5 may be passedthrough the hole. The ring 5 provides a structure in which the user maysecure the wearable terminal device 20 to his or her body. For example,a lanyard or other securing mechanism may be inserted through the ring 5such that the user may wear the wearable terminal device 20 around hisor her neck, his or her wrist, or on his or her clothing. Moreover,certain embodiments may include a specialized adapter such that the usermay affix the wearable terminal device 20 to his or her body or clothes.For example, there may be a specialized adapter such that the user maysecure the wearable terminal device 20 to his or her wrist, similar tothe case of a wrist watch.

FIG. 1B illustrates the wearable terminal device 20 with the slide part7 in the open position. When the wearable terminal device 20 is in thestate shown in the example of FIG. 1B, the automatic capturing of imagedata by the camera 24 may be performed at a predetermined or calculatedphotographing interval. For example, the user may wear the wearableterminal 20 around his or her neck with the slide part 7 in the openposition such that sequential images are captured at an interval definedby the photographing interval. Thus, the user is provided with a runninghistorical photography log documenting actions and events of the day. Aswill be discussed in detail in later paragraphs, the photographinginterval at which the camera 24 captures the image data may be changedbased on various factors relating to the user's behavior, such as his orher emotional state, physiological state, actions being performed, or acombination thereof.

FIG. 2 illustrates a non-limiting exemplary block diagram including theinternal structure of a wearable terminal device in a communicationapparatus that form a photographing system, according to certainembodiments. In particular, FIG. 2 illustrates the internal structure ofthe wearable terminal device 20 and a communication apparatus 30, whichform a photographing system 1.

Referring first to the block diagram corresponding to the wearableterminal device 20, the wearable terminal device 20 includes ashort-distance wireless processor 21 connected to an antenna 21 a, asensor section 22, a behavior recognition processor 23, a camera 24, amass-storage medium 25, read only memory (ROM) 26, random access memory(RAM) 27, central processing unit (CPU) 28, and operation key 29. Thewearable terminal device 20 also includes a bus on which various datasignals may be communicated amongst the various elements included in thewearable terminal device 20.

The antenna 21 a may transmit/receive electromagnetic wave signalsto/from other external apparatuses, and the short-distance wirelessprocessor 21 and/or the CPU 28 may control the wireless communicationperformed between the wearable terminal device 20 and the other externalapparatuses. Bluetooth and IEEE 802.11 are non-limiting examples ofwireless communication protocols that may be used for inter-devicecommunication via the short-distance wireless communication processor 21and the antenna 21 a.

The sensor section 22 may include one or more motion sensors capable ofdetermining various aspects of motion with respect to the wearableterminal device 20. For example, the sensor section 22 may include oneor more gyroscopes, accelerometers, geomagnetic sensors, or the like.For example, when the sensor section 22 includes a triaxial accelerationsensor, the acceleration sensor may regularly output an accelerationvalue corresponding to the X-axis, the Y-axis, and the Z-axis relativeto the wearable terminal device 20. Based on the acceleration valuesgenerated by the sensor, the CPU 28 and/or the behavior recognitionprocessor 23 may determine a behavior of the user in possession of thewearable terminal device 20 by matching the indication of motion (e.g.,the acceleration values) generated by the sensor section 22 with one ormore predetermined behaviors.

The behavior recognition processor 23 receives an indication of motionfrom the sensor section 22 and determines a behavior of the user of thewearable terminal device 20 based on the received indication of motion.For example, the behavior recognition processor 23 may receive motionsensor data from the sensor section 22 and determine an action performedby the user based on an analysis of the sensor data. For example, thebehavior recognition processor 23 may determine that the motion datareceived from the sensor section 22 corresponds to an action of walking,running, driving, etc., based on indications of velocity, speed, etc. Inresponse to determining the action or general behavior based on theinput from the sensor section 22, the behavior recognition processor 23may output the determined behavior to the CPU 28.

Image data may be captured by the wearable terminal device 20 via thecamera 24, which may include one or more image sensors comprised of acharge coupled device (CCD), complementary metal oxide semiconductor(CMOS), or the like. For example, an image signal may be generated bythe camera 24 when an image formed on a light receiving surface througha lens included in the camera is photoelectrically converted. The lensof the camera 24 may be arranged in certain embodiments on a surface ofthe wearable terminal device 20 that typically opposes the user's bodywhen he or she is wearing the wearable terminal device 20. The CPU 28may, in certain aspects over the present disclosure, include one or moreprocessing circuits for performing image analysis processing on stilland/or moving image data captured by the camera 24. Alternatively, thecamera 24 may include dedicated processing circuits for performing imageprocessing alone or in conjunction with the CPU 28. In certainembodiments, the image processing circuitry of the camera 24 and/or theCPU 28 may include facial recognition analysis or other image processingfor determining contents of an image and/or temporal changes in theimages.

The mass-storage medium 25 may store the image data captured by thecamera 24. In certain embodiments, the mass-storage medium 25 may becomprised of one or more semiconductor memory units, such as flashmemory. Image data stored in the mass-storage medium 25 may be regularlytransmitted to the communication apparatus 30 under the control of theCPU 28.

The ROM 26 may be a memory array comprised of nonvolatile memory unitsfor storing program instructions corresponding to processing algorithmsdiscussed in the present disclosure. Moreover, the ROM 26 may storeadditional instructions corresponding to other processing executed bythe wearable terminal device 20 processing circuitry, such asinstructions for controlling an operating system executed on thewearable terminal device 20 via, for example, the CPU 28.

The RAM 27 may be comprised of a memory array of volatile memory unitsthat may be utilized as working memory by the CPU 28 while executing theprocessing and algorithms of the present disclosure.

The CPU 28 may include one or more processing circuits for controllingeach element in the wearable terminal device 20 for performing featuresrelated to communication control, image processing and control, andother kinds of signal processing. The CPU 28 may perform these featuresby executing instructions stored in the ROM 26. Alternatively or inaddition to the local storage of the ROM 26, the features of the presentdisclosure may be executed using instructions stored in an externaldevice accessed on a network or on a non-transitory computer readablemedium accessed by the wearable terminal device 20. In certainembodiments, the CPU 28 controls a photographing interval used fordetermining a time interval at which the camera 24 performs automaticcapturing of image data. In certain embodiments, the CPU 28 may controlthe photographing interval of the wearable terminal device 20 based onan input from the behavior recognition processor 23 indicating abehavior exhibited by the user in possession of the wearable terminaldevice 20. Aspects of controlling image data capture based on adetermined photographing interval using inputs from the behaviorrecognition processor 23 will be discussed in greater detail in laterparagraphs.

The operation key 29 may include in one or more buttons similar toexternal control elements (e.g. power control, volume control, standbycontrol, etc.). The operation key 29 may generate an operation signalbased on a detected input generated in response to a user operating theoperation key 29. The operation signals generated by the operation key29 may be supplied to the CPU 28 for performing processing related tothe control of the wearable terminal device 20. For example, processingrelated to the control of the automatic capturing of image data based ona determined photographing interval may be performed in response to anoperation signal generated by the operation key 29.

Turning now to the communication apparatus 30, the communicationapparatus 30 includes a short-distance wireless communication processor31 connected to an antenna 31 a, a wireless communication processor 32connected to an antenna 32 a, a voice processor 33 connected to amicrophone 33 m and a speaker 33 s, a display 34, an operating portion35, a mass-storage medium 36, ROM 37, RAM 38, and CPU 39. Forsimplicity, the present disclosure assumes that the communicationapparatus 30 is a mobile device such as a smartphone or a tablet device.However, the present disclosure does not limit the communicationapparatus 30 to any particular structure or implementation. Thecommunication apparatus 30 also includes a bus for communicating datasignals amongst the various elements included in the communicationapparatus 30.

The antenna 31 a may transmit/receive electromagnetic wave signalsto/from other external apparatuses such as the wearable terminal device20. Communication control processing of the electromagnetic wave signalstransmitted to and from the antenna 31 a may be performed under thecontrol of the short-distance wireless communication processor 31 and/orthe CPU 39. Moreover, it may be assumed for simplicity that theshort-distance wireless communication processor 31 is functionallyequivalent to the short-distance wireless communication processor 21included in the wearable terminal device 20.

The wireless communication processor 32 controls communicationsperformed between the communication apparatus 30 and other externaldevices via the antenna 32 a. For example, the wireless communicationprocessor 32 may control communication between base stations forcellular telephone communication performed with the communicationapparatus 30.

The voice processor 33 demodulates and/or decodes audio data stored inmemory and/or audio data received from the wireless communicationprocessor 32 and/or the microphone 33 m.

The microphone 33 m detects surrounding audio and converts the detectedaudio into an audio signal. The audio signal may then be output to thevoice processor 33 and/or the CPU 39 for further processing. Moreover,the voice processor 33 may output the audio signal to the wirelesscommunication processor 32 such that the audio signal may be transmittedvia the antenna 32 a.

The speaker 104 emits an audio signal corresponding to audio datasupplied from the voice processor 33.

The display 34 may be a liquid crystal display (LCD), an organicelectroluminescent display panel (OLED), or another suitable displayscreen technology. In addition to displaying still and moving imagedata, the display 34 may display operational inputs, such as numbers oricons, which may be used for control of the communication apparatus 30.The display 34 may additionally display a graphical user interface withwhich a user may control aspects of the communication apparatus 30.Further, the display 34 may display characters in images received by thecommunication apparatus 30 over a network and/or stored in a memory suchas the mass-storage medium 36. For example, the communication apparatus30 may access a network such as the internet and display text and/orimage data transmitted from a Web server.

The operating portion 35 may include an operation interface forcontrolling the communication apparatus 30. For example, the operatingportion 35 may be implemented as a touch screen on which a user mayperform touch operations for controlling the communication apparatus 30.Assuming the operation portion 35 is implemented as a touch panel, theoperating portion 35 may include a physical touch panel displayintegrated with the display 34, as well as a touch panel driver. Thetouch panel may include one or more touch sensors for detecting an inputoperation on an operating surface of the touch panel display screen. Inone or more embodiments, the operating portion 35 when implemented as atouch panel display disposed adjacent to the display 34 (e.g.laminated), or the touch panel display may be formed integrally with thedisplay 34. The display 34 and the operating portion 35 may besurrounded by protective casing, which may also enclose the otherelements included in the communication apparatus 30.

The mass-storage medium 36 is a nonvolatile memory storage unit similarto the mass-storage medium 25 of the wearable terminal device 20. Themass-storage medium 36 may store image data and other data received orgenerated by the communication apparatus 30. For example, themass-storage medium 36 may store image data received by thecommunication apparatus 30 from the wearable terminal device 20.

The ROM 37 is nonvolatile memory for storing instructions correspondingto processes and algorithms according to the present disclosure.Further, the ROM 37 may store instructions corresponding to processingfor other processing features performed by the communication apparatus30. For example, the ROM 37 may store instructions corresponding to anoperating system executed on a communication apparatus 30.

The RAM 38 includes one or more volatile memory units may be used asworking memory by the CPU 39 when executing processing corresponding tothe communication apparatus 30.

The CPU 39 may include one or more processing circuits, and may controleach element in the communication apparatus 30 to perform featuresrelated to communication control, audio signal processing, control forthe audio signal processing, image processing and control, and otherkinds of signal processing. The controller may control these features byexecuting instructions stored in the ROM 37. Alternatively or inaddition to the local storage within the communication apparatus 30, thecontrol features executed the CPU 39 may be performed using instructionsstored in an external device accessed on a network or on anon-transitory computer readable medium accessed by the communicationapparatus 30.

Next, FIG. 3 illustrates a non-limiting exemplary photographing intervaltable for controlling a photographing interval of a wearable terminaldevice based on a detected behavior, according to certain embodiments.In certain embodiments, the interval table 41 illustrated in FIG. 3 maybe stored in a memory included in the wearable terminal device 20 and/orthe communication apparatus 30. The exemplary photographing intervaltable 41 of FIG. 3 includes columns for “behavior” and “photographinginterval (min)” corresponding to a detected behavior determined based onsensor inputs according to the present disclosure and the correspondingphotographing intervals assigned to each determined behavior,respectively. For example, referring to the data included in thephotographing interval table 41, the behavior recognition processor 23may determine, based on motion sensor inputs received from the sensorsection 22, that a user is performing a behavior corresponding to“walking.” Based on this determination result, the behavior recognitionprocessor 23 may output the determined behavior to the CPU 28. Inresponse to receiving the determined behavior from the behaviorrecognition processor 23, the CPU 28 may access the photographinginterval table 41 from the ROM 26. Additionally, the CPU 28 maydetermine, based on the data included in the photographing intervaltable 41, that a photographing interval of 3 minutes corresponds to thebehavior of walking. The CPU 28 may then control the camera 24 toautomatically capture image data at the determined photographinginterval. For example, assuming the CPU determines a photographinginterval of 3 minutes is to be applied, the CPU 28 may control thecamera 24 such that image data is captured once every 3 minutes.Implementations in which the camera 24 captures still images maycorrespond to capturing a single image with the camera 24 once every 3minutes. In other implementations in which the camera 24 captures movingimage data, the CPU 28 may control the camera 24 such that the camera 24captures a predetermined time period of video data once every 3 minutes(e.g. 5 seconds of video is captured once every 3 minutes). Processingsimilar to the processing described above for the example of walking mayalso be applied to determine that the user is running, and based on thedetermination that the user is running the CPU 28 may adjust thephotographing interval of the camera 24 such that image data is capturedonce per minute. Accordingly, by adjusting the photographing intervalsuch that image data is captured more frequently, the processingprovides the advantage of capturing image data when it is more likelythat the environment surrounding the wearable terminal device 20 ischanging more frequently due to the increased motion of the device. Thatis, when the user is walking it may not be necessary for image data tobe captured as frequently as when the user is running because thesurrounding environment with respect to the wearable terminal device 20does not change as frequently or as dramatically when the user iswalking compared to the case in which the user is running. In anotherexample, the behavior recognition processor 23 may determine that theuser is performing a behavior corresponding to bus travel. Thedetermination that the user is riding in a vehicle such as in a bus maybe determined based on the rate of change of motion detected by thesensor section 22, or by other geospatial location inputs such as a GPSsignal. In response to receiving an indication that the user iscurrently riding on a bus, the CPU 28 may control the camera 24 suchthat no photography is automatically captured at the photographinginterval.

The behavior and photographing interval data included in thephotographing interval table 41 is not limiting and is provided hereinmerely for exemplary illustration purposes. Other behaviors and/orphotographing intervals may be included in photographing interval tablesin embodiments according to the present disclosure. Moreover, a user maymanually enter or adjust behaviors in corresponding photographingintervals, for example, by performing inputs via the operating portion35 on the communication apparatus 30.

Next FIG. 4 illustrates a non-limiting exemplary sequence diagram forcontrolling a photographing interval of a wearable terminal device,according to certain embodiments. The non-limiting example of FIG. 4assumes the processing described in the sequence diagram is performed byelements included in the wearable terminal device 20. However, theprocessing described in FIG. 4 may be altered such that it isimplemented in other devices or a combination of devices (e.g., by acombination of processing circuitry included in the wearable terminaldevice 20 and the communication apparatus 30).

At step S1, the sensor section 22 outputs detected sensor data based ona motion of the wearable terminal device 22. For example, the sensorsection 22 at step S1 may output sensor data that includes one or morevalues corresponding to an acceleration, velocity, etc. in one more axeswith respect to the wearable terminal device 20.

At step S2, the CPU 28 receives the sensor data sent from the sensorsection 22, and the CPU 28 stores the received sensor data in the RAM 27(or another storage medium). In certain embodiments, the CPU 28 maystore the received sensor data for a predetermined time period such thatthe sensor data over the time period accumulates, e.g., as a timeseries. Accordingly, a user's behavior or action performed during thistime interval may be processed based on, for example, temporal changesin the sensor data across time. In certain embodiments, the CPU 28 maycontrol the time during which the sensor data is stored prior toproceeding to step S3. For example, if the behavior recognitionprocessor 23 previously determines that the user is performing a walkingaction, the CPU 28 may control the storage of received sensor data suchthat a greater amount of sensor data is stored relative to a previouslydetermined state in which the user is running. For example, the CPU 28may store 30 seconds of sensor data in the case in which the user ispreviously determined to be walking, and store 10 seconds of sensor datawhen it is previously determined that the user is running. The storedsensor data may then be analyzed by processing circuitry to determine acurrent behavior, and the process of storing and analyzing the sensordata may be repeated.

The skilled artisan will appreciate that the accuracy of thedetermination of behaviors and actions performed by the behaviorrecognition processor 23 (or other circuitry) will increase as theamount of sensor data analyzed increases. Accordingly, controlling thestorage amount via the CPU 28 improves accuracy of the behaviorrecognition result when a current or immediately preceding action isknown to have occurred. Moreover, since the operation rate of the CPU 28can be changed according to a user's determined action or behavior,consumption of electric power by the wearable terminal device 20 mayalso be minimized.

At step s3, the CPU 28 transmits the accumulated sensor data stored inthe RAM 27 to the behavior recognition processor 23.

At step S4, the behavior recognition processor 23 receives the sensordata transmitted from the CPU 28, and the behavior recognition processor23 performs processing related to a determination of a behavior or anaction performed by a user in possession of the wearable terminal device20. The behavior recognition processor 23 generates a recognition resultbased on the analysis of the sensor data received at step S4, and therecognition result is transmitted by the behavior recognition processor23 to the CPU 28 at step S5.

At step S6, the CPU 28 receives the recognition result transmitted bythe behavior recognition processor 23. Based on the received recognitionresult, the CPU 28 performs processing related to the control/adjustingof a photographing interval corresponding to the camera 24. In one ormore embodiments, the CPU 28 at step S6 may reference a photographinginterval table such as the photographing interval table 41 shown in FIG.3. In other embodiments, the CPU 28 may apply the recognition result toa mathematical formula for determining a photographing intervalcorresponding to the camera 24. In the example where a photographinginterval table is used at step S6, the CPU 28 selects a correspondingphotographing interval based on the received recognition result. Inaddition, in certain embodiments, the CPU 28 may adjust a storage timeof the received sensor data, as discussed above with regard to theprocessing performed at step S1.

At step S7, the CPU 28 transmits a photographing request signal to thecamera 24 at a frequency corresponding to the photographing interval.Accordingly, the CPU 28 controls the camera 24 such that the camera 24captures image data at an interval corresponding to the determinedphotographing interval from step S6. In response to receiving thephotographing request signal at step S7, the camera 24 captures theimage data at the determined photographing interval and stores thecaptured image data in the mass-storage medium 25.

Next, FIG. 5 illustrates another non-limiting exemplary block diagramincluding an internal structure of a wearable terminal device and acommunication apparatus that form a photographing system, according tocertain embodiments. Specifically, the exemplary photographing system 1shown in FIG. 5 includes the communication apparatus 30 of FIG. 2 in amodified wearable terminal 20A.

The exemplary wearable terminal 20 a shown in FIG. 5 includes astructure in which a sensor controller 22 a is added to the wearableterminal device 20 of FIG. 2. The sensor controller 22 a acquires thedetected sensor data generated in response to a motion of the wearableterminal device 20A from the sensor section 22, and analyzes thereceived sensor data. The sensor controller 22 a transmits the analyzedsensor data to the CPU 28. For example, the sensor section 22 mayinclude one or more motion sensors and one or more geospatialpositioning sensors that respectively generate sensor data. The sensorcontroller 22 a may receive motion sensor data generated by the motionsensors of sensor section 22 in response to motion of the wearableterminal 20 a, and the sensor controller 22 a may receive positionsensor data generated based on a received geospatial location signal(e.g. a global positioning system (GPS) signal transmitted by asatellite) indicating a latitude, longitude, elevation, etc., of thewearable terminal device 20A. Rather than transmitting the receivedsensor data to the CPU 28 for processing prior to a behavior recognitiondetermination being performed, the sensor controller 22 a analyzes thereceived sensor data, which thereby decreases the processing load of theCPU 28.

Next, FIG. 6 illustrates another non-limiting exemplary block diagramincluding an internal structure of a wearable terminal device in acommunication apparatus that form a photographing system, according tocertain embodiments. Specifically, the exemplary photographing system 1includes the communication apparatus 30 from FIG. 2 and a modifiedwearable terminal device 20B.

The wearable terminal device 20B is modified with respect to thewearable terminal device 20 of FIG. 2 in that rather than a singlesensor section 22 being included within the wearable terminal device asin FIG. 2, the wearable terminal device 20B includes a first sensorsection 51 and a second sensor section 52. In certain embodiments, thefirst sensor section 51 and the second sensor section 52 may eachinclude one or more motion sensors that generate motion sensor data forperforming a behavior recognition determination via the behaviorrecognition processor 23. For example, the first sensor section 51 mayinclude an accelerometer and the second sensor section 52 may include agyroscope. Accordingly, acceleration data generated by the first sensorsection 51 and gyroscope data generated by the second sensor section 52may each be transmitted to the CPU 28 and later to the behaviorrecognition processor 23 such that a more accurate determination of theuser's behavior may be performed.

In certain embodiments, the first sensor section 51 may include one ormore motion sensors and the second sensor section 52 may include sensorsother than motion sensors. For example, the second sensor section 52 mayinclude one or more biological sensors that generate biological sensordata based on a physiological state of the user. Exemplary biologicalsensor data corresponding to a physiological state of the user includes,for example, an indication of the user's body temperature, heart rate,blood pressure, perspiration, etc., which may be determined based onvarious sensors corresponding to these physiological measurements(resistance thermometers (RTDs), pulse monitors, etc.). Unlike arecognition of a user's behavior or an action performed by the user asdiscussed above, a biological or physiological condition of the user maybe implemented for controlling a photographing interval of the camera 24such that the biological or physiological state of the user is thetrigger for controlling the automatic photography. For example, thephotographing interval of the camera 24 may be controlled based on adetection of a user's stress level, an emotion expressed by the user, astate of mind of the user, etc.

In embodiments including biological sensors, the behavior recognitionprocessor 23 and/or the CPU 28 may be modified such that processingrelated to the determination of the user's biological or physiologicalcondition may be performed by these processing circuitry elements. Forexample, the behavior recognition processor 23 may receive biologicalsensor data from the second sensor 52 and determine an emotional and/orbiological condition of the user, and the emotion and/or biologicalcondition of the user may be transmitted to the CPU 28 such that the CPU28 controls a photographing interval of automatic photography capturedby the camera 24.

In certain embodiments, the behavior recognition processor 23 may alsoreceive motion sensor data from the first sensor section 51 such thatthe control of the photographing interval of the camera 24 performed bythe CPU 28 is based both on the determined behavior/action of the user,as well as the determination result of the user's physiological,biological, emotional, etc., state generated by the biological sensordata. For example, when a user is in a resting state, some event maygenerate a measurable response in pulse or body temperature changes withrespect to the user, and the behavior recognition processor 23 mayreceive sensor data corresponding to this condition and output thedetermination result to the CPU 28 such that the photographing intervalof the camera 24 is adjusted. That is, while motion sensor dataindicating that the user was resting may typically result in a decreasedphotographing interval being determined, implementations in which thephotographing interval is controlled based on a combination of motionand biological sensor data provide a more robust capability ofdetermining a contextual environment with respect to the user, whichimproves the determination as to when a higher frequency of image datacapturing would be desirable.

Moreover, in certain embodiments, the CPU 28 may selectively determinewhen motion sensor data and/or biological sensor data are applied forcontrolling and adjusting the photographing interval of the camera 24.For example, when the behavior recognition processor 23 determines,based on received motion sensor data from the first sensor section 51,that the user is currently running, the CPU 28 may discount theimportance of changes in the user's pulse and/or body temperature sincethese changes are an expected result of the user's behavior.Accordingly, the CPU 28 may adjust the photographing interval of thecamera 24 based mainly on the behavior recognition result and to alesser extent on the physiological state of the user.

In certain embodiments, the second sensor section 52 may include ageospatial positioning sensor for determining a geospatial position ofthe wearable terminal device 20B. For example, using a GPS signalreceived by the geospatial position sensor included in the second sensorsection 52, the CPU 28 may determine a present location of the wearableterminal device 20B (e.g. in a user's house, in a user's office, at atravel destination, etc.). Based on a determination of the currentgeospatial position of the wearable terminal device 20B, the CPU 28 mayadjust a photographing interval of the camera section 24. Additionally,in certain embodiments, the photographing interval of the camera 24 maybe adjusted by the CPU based on a combination of geospatial positiondata and a behavior recognition result generated by the behaviorrecognition processor 23. Moreover, in certain embodiments, the CPU 28may adjust the photographing interval of the camera 24 based on acombination of inputs indicating a physiological state of the user, ageospatial position of the user, and a behavior/action of the user.

As an example of controlling a photographing interval of the camera 24in response to a geospatial position determination of the wearableterminal device 20B, the CPU 28 may receive an indication that thewearable terminal device 20B is presently at a travel destination ratherthan the user's home. Additionally, the CPU 28 may receive a behaviorrecognition result from the behavior recognition processor 23 indicatingthat the user is currently walking. Based on this combination of inputs,the CPU 28 may adjust the camera 24 photographing interval such that thephotographing interval is lower when it is determined that the user iswalking while traveling relative to a determination that the user iswalking while at home.

In certain embodiments, an imaging sensor may be included in the secondsensor section 52 such that image analysis may be performed and outputfor inclusion in processing for adjusting a photographing interval ofthe camera 24. Alternatively, the CPU 28 and/or the camera 24 mayinclude processing circuitry for performing image analysis on image datacaptured by the camera 24 and/or received from communications on anetwork by the wearable terminal device 20B. An image analysis resultperformed on image data captured by the camera 24 may be applied fordetermining a behavior or action performed by the user, as well as acurrent location of the user. For example, image analysis may beperformed on image data captured sequentially by the camera 24 such thatit is determined, based on a lack of significant temporal changes in thecaptured image data, that the user is currently in the resting state.Accordingly, the CPU 28 may receive the image analysis result indicatingthat the user is in the resting state, and the CPU 28 may control thephotographing interval of the camera 24 such that it is decreased inorder to prevent redundant pictures from being taken while the wearableterminal device 20B is not moving. Additionally, image analysisprocessing may be performed on image data captured by the camera 24 suchthat individuals included in the image data are recognized via facialrecognition methods. Accordingly, the CPU 28 may control thephotographing interval of the camera 24 based on the facial recognitionresult. When image analysis is performed by processing circuitryincluded in the wearable terminal device 20B, image data may be storedover time in the RAM 27 and/or the mass-storage medium 25 such thatanalysis over a predetermined time period may be performed. For example,the CPU 28 may analysis sequential images included in image data storedin the RAM 27 such that a determination of temporal changes across thesequence of images is performed.

It should be appreciated that while a variety of sensor types aredescribed herein with respect to the first sensor section 51 and thesecond sensor section 52, embodiments of the present disclosure mayperform processing related to the control of a photographing interval ofthe camera 24 based on a single type of sensor data. For example, theCPU 28 may selectively perform control of the photographing interval ofthe camera 24 based on one of motion sensor data, biological sensordata, and image sensor data. Moreover, as mentioned previously, acombination of sensor data may also be applied for controlling thephotographing interval of the camera 24.

Regarding image sensor data, and specifically regarding facialrecognition techniques performed by image sensors and related processingcircuitry, the CPU 28 may, in certain embodiments, control thephotographing interval of the camera 24 based on predeterminedrelationships with recognized faces within the image data. For example,the CPU 28 may control the photographing interval of the camera 24 whenthe image analysis result indicates a particular user is included withinan image (e.g. a correspondence between a known individual and thefacial recognition analysis result may be stored in the ROM, and the CPU28 may perform the comparison based on the stored correspondence data).Additionally, in certain embodiments, the image analysis and relatedfacial recognition may include processing for determining an emotionalstate of the individuals included in the image data. For example, theimage analysis may determine that an individual within an image issmiling, and the CPU 28 may control the photographing interval of thecamera 24 such that the interval decreases in response to detecting thesmiling individual.

Next FIG. 7 illustrates a non-limiting exemplary photographing intervaltable for controlling a photographing interval of a wearable terminaldevice based on a detected physiological state, according to certainembodiments. As discussed previously, the physiological states shown inFIG. 7 may be determined by the control circuitry included in thewearable terminal device based on sensor data received from one or morebiological sensors included in the wearable terminal device.

Photographing interval table 42 of FIG. 7 includes three columnscorresponding to “measurement item,” “average value,” and “photographinginterval (min).” The measurement item column corresponds to variousphysiological states that may be determined by the control circuitry ofthe wearable terminal device based on sensor data from one or morebiological sensors. The exemplary physiological conditions included inthe photographing interval table 42 include body temperature, pulse,heart rate, and blood pressure. In certain embodiments, biologicalsensor data may be received and analyzed by the control circuitry of thewearable terminal device such that an average value of each respectivemeasurement is taken over the time period. The control circuitry maythen calculate the average value and compare the average value to thedata included in the photographing interval table 42. For example, basedon the received biological sensor data, the control circuitry maydetermine that the user's body temperature is greater than or equal tothe average value “a” listed in the photographing interval table 42. Inresponse to determining that the user's body temperature is greater thanor equal to the average value “a,” the control circuitry of the wearableterminal device may control the photographing interval of the wearableterminal device camera such that image data is captured at an intervalcorresponding to “A” minutes. Similar processing may be performed forcontrolling a photographing interval of a camera included in a wearableterminal device based on biological sensor data corresponding to pulseand heart rate.

FIG. 7 shows average values “d1” and “d2” corresponding to the bloodpressure measurement item. In this example, different photographinginterval values may be assigned to various ranges within a particularmeasurement item. For example, when the control circuitry of thewearable terminal device determines, based on biological sensor datareceived by the control circuitry, that the user's blood pressure isbetween the average values d1 and d2, the control circuitry may adjustthe photographing interval of the wearable terminal device camera suchthat the photographing interval is D1 minutes. Similarly, when thecontrol circuitry determines that the user's blood pressure is greaterthan the value d2, the control circuitry may control the photographinginterval of the camera such that the interval is set at D2 minutes.

The time interval during which the average value of the variousbiological sensor measurement items is taken may be set to sufficientlycapture the average value with desired accuracy. Moreover, in certainembodiments, an instantaneous value of various measurement items may beapplied for determining and controlling the photographing interval ofthe wearable terminal device camera. Moreover, in certain embodiments, amathematical function may be applied for determining a photographinginterval based on a received value corresponding to each of thebiological sensor data measurement items. Moreover, the exemplaryphotographing interval table may be altered such that other measurementitems are included in the table and/or different average measurementvalues and photographing interval values are applied to each of thecorresponding measurement items. Moreover, as discussed previously, thecontrol of the photographing interval may be based on a combination ofbiological sensor data and other sensor data that may be received andanalyzed by the wearable terminal device control circuitry. For example,the biological sensor data and photographing interval table 42 may beapplied in combination with motion sensor data, geological positionsensor data, and image sensor data in order to determine a photographinginterval for a wearable terminal device camera.

Next FIG. 8 illustrates a non-limiting exemplary photographing intervaltable for controlling a photographing interval of a wearable terminaldevice based on a detected emotional state, according to certainembodiments. As discussed previously, an emotional state of a user maybe determined based on biological sensor data inputs received by controlcircuitry and a wearable terminal device. For example, the controlcircuitry of the wearable terminal device may determine based on one ormore measurements received from the biological sensor(s) that a user ishappy, angry, stressed, nervous, etc. Accordingly, the determination ofthe user's emotional state may be applied for controlling aphotographing interval of a wearable terminal device camera usingmethods described herein.

Referring to FIG. 8, photographing interval table 43 includes columnsfor “emotion” and “photographing interval (min).” In this example, thecontrol circuitry of the wearable terminal device may determine, basedon received biological sensor data, that the user is presently nervous.For example, the biological sensor data received by the controlcircuitry may include indications of a user's body temperature, heartrate, and blood pressure, which correspond to a state typicallyassociated with nervousness. Based on this determination of the user'semotional state, the control circuitry of the wearable terminal devicemay control a photographing interval of the camera such that theinterval is set to a value corresponding to the emotional state from thephotographing interval table 43, which in this case corresponds to valueP5. Because it may be preferable or desirable by the user that thephotographing interval of the camera when the user is presently nervousis set to a value that results in fewer pictures taken then when theuser is otherwise not stressed (e.g. happy), the interval value P5 maybe set to a lower value than, for example, the interval valuescorresponding to “glad” and “happy” emotional states from thephotographing interval table 43. However, the present example is notlimited to any particular value of photographing interval or emotionalstates, and other methods may be applied for determining a photographinginterval based on a determination result for the user's emotional state.Moreover, the user may adjust the data included in the photographinginterval table 43 such that desired photographing interval values and/oremotional states may be directly entered using, for example, the touchscreen provided in operating portion 35 of the communication apparatus30. Similar manual entry of photographing interval table data may beperformed for any of the photographing interval tables described herein.

Next FIG. 9 illustrates another non-limiting exemplary block diagramincluding an internal structure of a wearable terminal device and acommunication apparatus that form a photographing system, according tocertain embodiments. Specifically, the exemplary photographing system 1illustrated in FIG. 9 includes a modified wearable terminal device 20Cand a modified communication apparatus 30C. The difference between thephotographing system 1 of FIG. 2 and the photographing system 1illustrated in FIG. 9 is the point by which the behavior recognitionprocessor 23 is not provided in the wearable terminal device 20C, butrather is included in the communication apparatus 30C. That is, althoughall of the processing circuitry necessary for adjusting a photographinginterval of the camera 24 is included in the wearable terminal device20C, the determination as to a user's behavior, emotional state,physiological state, etc., may be performed by processing circuitryincluded in another device, such as the communication apparatus 30C. Inthis case, the sensor data generated by the sensor section 22 may betransmitted via the short-distance wireless processor 21 and the antenna21 a to the communication apparatus 30C, where the behavior recognitionprocessor 23 performs the determination that may be applied foradjusting the photographing interval of the camera 24. Specifically, inresponse to receiving the sensor data from the wearable terminal device20C, the behavior recognition processor 23 of the communicationapparatus 30C may perform a determination as to the user's behavior andreturn the results to the wearable terminal device 20C of the othershort-distance wireless processor 31 and the antenna 31 a. In responseto receiving the recognition result from the communication apparatus30C, the CPU 28 of the wearable terminal device 20C may control thephotographing interval of the camera 24 such that the intervalcorresponds to the determined behavior corresponding to the user.

Next, FIG. 10 illustrates a non-limiting exemplary photographing systemthat includes a server with circuitry for controlling a photographinginterval of a wearable terminal device, according to certainembodiments.

The exemplary photographing system 70 illustrated in FIG. 10 includes aserver 64 included within a cloud 63. The cloud 63 may be accessed via anetwork 62 via base station 61 and antenna 61 a. For example, thewearable terminal device 20C may generate sensor data corresponding to auser's behavior, physiological state, emotion state, etc., and transmitthe sensor data to the communication apparatus 30. The communicationapparatus 30 may transmit the sensor data to the server 64 via thenetwork 62, the base station 61, and the antenna 61 a. In response toreceiving the sensor data, the server 64 may determine, for example, auser's behavior, based on processing performed by the behaviorrecognition processor 23. Additionally, based on the result of thebehavior recognition processing, a photographing interval adjustingprocessor 65 may control the photographing interval of a camera includedin the wearable terminal device 20C. That is, the photographing intervalprocessor 65 may perform processing that was previously described asbeing performed by the CPU 28 in the wearable terminal device 20C. Thecontrol signal corresponding to the adjusting of the photographinginterval may be transmitted from the server 64 to the communicationapparatus 30 via the network 62, and the communication apparatus 30 maytransmit the control signal to the wearable terminal device 20C suchthat the CPU 28 can control the photographing interval of the camera 24based on the control signal generated by the server 64. Accordingly, theprocessing workload of the control circuitry included in the wearableterminal device 20C may be decreased since processing previouslydescribed as being performed by the control circuitry of the wearableterminal device 20C is now performed by processing circuitry included inthe server 64. Similar results may be obtained by including one or moreof the behavior recognition processor 23 and the photographing intervaladjusting processor 65 within the communication apparatus 30 such thatthe processing corresponding to the adjusting of the photographinginterval is distributed across the processing circuitry included invarious devices. Accordingly, circuitry included in the wearableterminal device 20C may be simplified.

Obviously, numerous modifications and variations of the presentdisclosure are possible in light of the above teachings. It is thereforeto be understood that within the scope of the appended claims, theinvention may be practiced otherwise than as specifically describedherein. For example, advantageous results may be achieved if the stepsof the disclosed techniques were performed in a different sequence, ifcomponents in the disclosed systems were combined in a different manner,or if the components were replaced or supplemented by other components.The functions, processes and algorithms described herein may beperformed in hardware or software executed by hardware, includingcomputer processors and/or programmable processing circuits configuredto execute program code and/or computer instructions to execute thefunctions, processes and algorithms described herein. A processingcircuit includes a programmed processor, as a processor includescircuitry. A processing circuit also includes devices such as anapplication specific integrated circuit (ASIC) and conventional circuitcomponents arranged to perform the recited functions.

The functions and features described herein may also be executed byvarious distributed components of a system. For example, one or moreprocessors may execute these system functions, wherein the processorsare distributed across multiple components communicating in a network.The distributed components may include one or more client and/or servermachines, in addition to various human interface and/or communicationdevices (e.g., display monitors, smart phones, tablets, personal digitalassistants (PDAs)). The network may be a private network, such as a LANor WAN, or may be a public network, such as the Internet. Input to thesystem may be received via direct user input and/or received remotelyeither in real-time or as a batch process. Additionally, someimplementations may be performed on modules or hardware not identical tothose described. Accordingly, other implementations are within the scopethat may be claimed.

It must be noted that, as used in the specification and the appendedclaims, the singular forms “a,” “an,” and “the” include plural referentsunless the context clearly dictates otherwise.

The above disclosure also encompasses the embodiments noted below.

(1) A wearable terminal device comprising: circuitry configured toreceive sensor data from one or more sensors, wherein the sensor datacorresponds to a behavior of a user in possession of the wearableterminal device; determine, based on the sensor data, the behavior ofthe user; and control, based on the determined behavior of the user, aphotographing interval of a camera.

(2) The wearable terminal device of (1), wherein the photographinginterval of the camera determines the frequency at which the cameraperforms automatic capturing of image data.

(3) The wearable terminal device of (1) or (2), wherein the one or moresensors include at least one motion sensor.

(4) The wearable terminal device of any one of (1) to (3), wherein thesensor data includes an indication of a motion of one or more of thewearable terminal device and the user, and the circuitry is furtherconfigured to determine the behavior of the user based on the indicationof the motion.

(5) The wearable terminal device of any one of (1) to (4), wherein thecircuitry is configured to decrease the photographing interval when theindication of the motion indicates that the motion is decreasing.

(6) The wearable terminal device of any one of (1) to (5), wherein: theone or more sensors include at least one geospatial positioning sensor,and the circuitry is further configured to determine the behavior of theuser based on the indication of the motion and a location input receivedfrom the at least one geospatial positioning sensor.

(7) The wearable terminal device of any one of (1) to (6), wherein thecircuitry is configured to decrease the photographing interval when achange in the location input decreases.

(8) The wearable terminal device of any one of (1) to (7), wherein: theone or more sensors include at least one biological sensor configured togenerate biological sensor data based on a physiological state of theuser, and the circuitry is further configured to determine the behaviorof the user based on the indication of the motion and the biologicalsensor data.

(9) The wearable terminal device of any one of (1) to (8), wherein thephotographing interval of the camera determines the frequency at whichthe camera performs automatic capturing of image data, the circuitry isconfigured to perform image analysis of each image included in the imagedata captured by the camera, and the circuitry is further configured todetermine the behavior of the user based on the indication of the motionand a result of the image analysis.

(10) The wearable terminal device of any one of (1) to (9), wherein theresult of the image analysis includes an indication of temporal changesin the image data.

(11) The wearable terminal device of any one of (1) to (10), wherein:the circuitry is configured to recognize one or more faces in the imagedata, and the circuitry is further configured to determine the behaviorof the user based on the indication of the motion and the one or morefaces recognized in the image data.

(12) The wearable terminal device of any one of (1) to (11), wherein thecamera is included in the wearable terminal device.

(13) A wearable terminal device comprising: circuitry configured toreceive sensor data from one or more sensors, wherein the sensor datacorresponds to a psychological state of a user in possession of thewearable terminal device; determine, based on the sensor data, thepsychological state of the user; and control, based on the determinedpsychological state of the user, a photographing interval of a camera.

(14) The wearable terminal device of (13), wherein the one or moresensors include at least one biological sensor.

(15) The wearable terminal device of (13) or (14), wherein the at leastone biological sensor measures physiological conditions of the user'sbody.

(16) The wearable terminal device of any one of (13) to (15), whereinthe physiological conditions include one or more of heart rate,temperature, perspiration, breathing rate, and blood pressure.

(17) The wearable terminal device of any one of (13) to (16), whereinthe one or more sensors include at least one motion sensor; the sensordata includes an indication of a motion of one or more of the wearableterminal device and the user, and the circuitry is further configured tocontrol the photographing interval of the camera based on thepsychological state of the user and the motion.

(18) The wearable terminal device of any one of (13) to (17), whereinthe camera is included in the wearable terminal device.

(19) A photographing system comprising: a wearable terminal deviceincluding a camera configured to capture image data at a photographinginterval; one or more sensors configured to generate sensor data,wherein the sensor data corresponds to a behavior of a user inpossession of the wearable terminal device; and circuitry configured totransmit the sensor data to one or more external devices, receive anindication of a behavior of the user, and determine, based on theindication of the behavior of the user, the photographing interval ofthe camera, and control the camera to capture the image data at thedetermined photographing interval; and a communication device includingcircuitry configured to receive the sensor data from the wearableterminal device, determine, based on the sensor data, the behavior ofthe user, and output the determination result of the behavior of theuser to the wearable terminal device.

(20) The photographing system of (19), wherein the circuitry of thecommunication apparatus is further configured to: determine, based onthe indication of the behavior of the user, the photographing intervalof the camera, and control the camera to capture the image data at thedetermined photographing interval.

1. A wearable terminal device comprising: circuitry configured toreceive sensor data from one or more sensors, wherein the sensor datacorresponds to a behavior of a user in possession of the wearableterminal device; determine, based on the sensor data, the behavior ofthe user; and control, based on the determined behavior of the user, aphotographing interval of a camera.
 2. The wearable terminal device ofclaim 1, wherein the photographing interval of the camera determines thefrequency at which the camera performs automatic capturing of imagedata.
 3. The wearable terminal device of claim 1, wherein the one ormore sensors include at least one motion sensor.
 4. The wearableterminal device of claim 3, wherein the sensor data includes anindication of a motion of one or more of the wearable terminal deviceand the user, and the circuitry is further configured to determine thebehavior of the user based on the indication of the motion.
 5. Thewearable terminal device of claim 4, wherein the circuitry is configuredto decrease the photographing interval when the indication of the motionindicates that the motion is decreasing.
 6. The wearable terminal deviceof claim 4, wherein: the one or more sensors include at least onegeospatial positioning sensor, and the circuitry is further configuredto determine the behavior of the user based on the indication of themotion and a location input received from the at least one geospatialpositioning sensor.
 7. The wearable terminal device of claim 6, whereinthe circuitry is configured to decrease the photographing interval whena change in the location input decreases.
 8. The wearable terminaldevice of claim 4, wherein: the one or more sensors include at least onebiological sensor configured to generate biological sensor data based ona physiological state of the user, and the circuitry is furtherconfigured to determine the behavior of the user based on the indicationof the motion and the biological sensor data.
 9. The wearable terminaldevice of claim 4, wherein the photographing interval of the cameradetermines the frequency at which the camera performs automaticcapturing of image data, the circuitry is configured to perform imageanalysis of each image included in the image data captured by thecamera, and the circuitry is further configured to determine thebehavior of the user based on the indication of the motion and a resultof the image analysis.
 10. The wearable terminal device of claim 9,wherein the result of the image analysis includes an indication oftemporal changes in the image data.
 11. The wearable terminal device ofclaim 9, wherein: the circuitry is configured to recognize one or morefaces in the image data, and the circuitry is further configured todetermine the behavior of the user based on the indication of the motionand the one or more faces recognized in the image data.
 12. The wearableterminal device of claim 1, wherein the camera is included in thewearable terminal device.
 13. A wearable terminal device comprising:circuitry configured to receive sensor data from one or more sensors,wherein the sensor data corresponds to a psychological state of a userin possession of the wearable terminal device; determine, based on thesensor data, the psychological state of the user; and control, based onthe determined psychological state of the user, a photographing intervalof a camera.
 14. The wearable terminal device of claim 13, wherein theone or more sensors include at least one biological sensor.
 15. Thewearable terminal device of claim 14, wherein the at least onebiological sensor measures physiological conditions of the user's body.16. The wearable terminal device of claim 15, wherein the physiologicalconditions include one or more of heart rate, temperature, perspiration,breathing rate, and blood pressure.
 17. The wearable terminal device ofclaim 15, wherein the one or more sensors include at least one motionsensor; the sensor data includes an indication of a motion of one ormore of the wearable terminal device and the user, and the circuitry isfurther configured to control the photographing interval of the camerabased on the psychological state of the user and the motion.
 18. Thewearable terminal device of claim 13, wherein the camera is included inthe wearable terminal device.
 19. A photographing system comprising: awearable terminal device including a camera configured to capture imagedata at a photographing interval; one or more sensors configured togenerate sensor data, wherein the sensor data corresponds to a behaviorof a user in possession of the wearable terminal device; and circuitryconfigured to transmit the sensor data to one or more external devices,receive an indication of a behavior of the user, and determine, based onthe indication of the behavior of the user, the photographing intervalof the camera, and control the camera to capture the image data at thedetermined photographing interval; and a communication device includingcircuitry configured to receive the sensor data from the wearableterminal device, determine, based on the sensor data, the behavior ofthe user, and output the determination result of the behavior of theuser to the wearable terminal device.
 20. The photographing system ofclaim 19, wherein the circuitry of the communication apparatus isfurther configured to: determine, based on the indication of thebehavior of the user, the photographing interval of the camera, andcontrol the camera to capture the image data at the determinedphotographing interval.